Majorization, Csiszár divergence and Zipf-Mandelbrot law
نویسندگان
چکیده
In this paper we show how the Shannon entropy is connected to the theory of majorization. They are both linked to the measure of disorder in a system. However, the theory of majorization usually gives stronger criteria than the entropic inequalities. We give some generalized results for majorization inequality using Csiszár f-divergence. This divergence, applied to some special convex functions, reduces the results for majorization inequality in the form of Shannon entropy and the Kullback-Leibler divergence. We give several applications by using the Zipf-Mandelbrot law.
منابع مشابه
Zipf–Mandelbrot law, f-divergences and the Jensen-type interpolating inequalities
Motivated by the method of interpolating inequalities that makes use of the improved Jensen-type inequalities, in this paper we integrate this approach with the well known Zipf-Mandelbrot law applied to various types of f-divergences and distances, such are Kullback-Leibler divergence, Hellinger distance, Bhattacharyya distance (via coefficient), [Formula: see text]-divergence, total variation ...
متن کاملBeyond the Zipf-Mandelbrot law in quantitative linguistics
In this paper the Zipf-Mandelbrot law is revisited in the context of linguistics. Despite its widespread popularity the Zipf–Mandelbrot law can only describe the statistical behaviour of a rather restricted fraction of the total number of words contained in some given corpus. In particular, we focus our attention on the important deviations that become statistically relevant as larger corpora a...
متن کاملIs space a word, too?
For words, rank-frequency distributions have long been heralded for adherence to a potentiallyuniversal phenomenon known as Zipf’s law. The hypothetical form of this empirical phenomenon was refined by Ben̂ıot Mandelbrot to that which is presently referred to as the Zipf-Mandelbrot law. Parallel to this, Herbert Simon proposed a selection model potentially explaining Zipf’s law. However, a signi...
متن کاملOn a General Theorem of Number Theory Leading to the Gibbs, Bose–Einstein, and Pareto Distributions as well as to the Zipf–Mandelbrot Law for the Stock Market
The notion of density of a finite set is introduced. We prove a general theorem of set theory which refines the Gibbs, Bose–Einstein, and Pareto distributions as well as the Zipf law.
متن کاملMinimum cost and the emergence of the Zipf-Mandelbrot law
This paper illustrates how the Zipf-Mandelbrot law can emerge in language as a result of minimising the cost of categorising sensory images. The categorisation is based on the discrimination game in which sensory stimuli are categorised at different hierarchical layers of increasing density. The discrimination game is embedded in a variant of the language game model, called the selfish game, wh...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
دوره 2017 شماره
صفحات -
تاریخ انتشار 2017